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Remarks 

The present inventioii relates to a method for allocating bits to encode each frame of an 
image sequence, where each frame of the image sequence has at least one object The method 
(as set forth in amended Claim 22 above) generally comprises: 

(a) determining a target frame bit rate for the frame; and 

(b) allocaling the target frame bit rate among the at least one object in 
accordance with a target object bit rale for the at least one object 

In fitrthcr embodiments, the present invention relates to a computer-readable medium 
(containing instractions generally to perform the present method; see amended Claim 32 above), 
and an apparatus for encoding each frame of an image sequence. The apparatus (as set forth in 
amended Claim 29 above) generally comprises: 

(a) a motion compensator for genemttng a predicted image of a current frames 

(b) a transform module for applying a transfijrmation to a difference signal 
between the current frame and the predictal lmage» where the transfonnalion produces a 
plurality of coefficients; 

(c) a quantizer for quantiring the plurality of coefficients with at least one 
quantizer scale; and 

(d) a controller for selectively adjusting the at least one quantizer scale for a 
current frame in response to a taj^et object bit rate for the at least one object, and for determining 
the target object bit rate from a target fhrnie bit mte. 

The reference cited against the claims (Eleftheriadis ct al, US- Pat No. 6,055^330 
[hereinafter ""Eieftberiadis^]) does not disclose tlie present allocating step (sec amended Claim 
22). Furthermore, Eleftheriadis does not disclose a controller for determining the target object 
bit rate from a target frame bit mte (sec amended Claim 29). Consequently^ the present claims 
are patentable over the cited references. 
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Clarm Rfciections Under The Judidally Created_DoctriTifcjOf_Doublc Patenting 

Applicants provisionally agree to file a tenninal disclaimer to overcome the non-statutory 
double patenting rejection of claims 22-24, 27-34 and 37-38. Tn particular. Applicants will file 
the terminal disclaimer if and when all of the other claim rejections have been resolved* 



Claim Rejection Under 35 U.S.C. g1Q2 

The rejection of claims 22-30 and 32-50 under 35 U.S*C. § 102(c) as being anticipated by 
Eleftheriadis is rcspcctfiilly traversed and should be withdrawn* 

Elcftbcriadis discloses a method and apparatus for performing digital image and video 
scgmeniation and compression using 3-t> depth information (Title). In contrast to the present 
claims 22 and 32, whici redle allocating the target object bit ratc(s) in accordance with the 
target &amc rate, Hcfibcriadis appears to determine a target object bit rate based on a quantiser 
(the value of which appears to be related to the distance of the object from the camera; see, e,g.> 
coLll.U. 1-lSand 41-44), 

For example, Eleftheriadis discusses two coding techniques for controlling bit rates, 
variable bit rale (VBR) coding and constant bit rate (CBR) coding (sec coL 8, 11. 8-19 and col. 
11, 11. 39-64), Eleflhetiadis discloses a constant bit rate encoder (FIG. 10), in which an object 
map generated by object segmentation circuit 500 is received by a macroblock labeling circuit 
1 100 (sec eoL 10, 1* 6Sh:oL 11,1. 1). Since the encoder splits each frame of video information 
received from the camera into macroblocks and quantises DCT cocfiSdcnts on a macroblock 
basis, Eleftheriadis teaches that it is desirable to assign each macroblock of video data to a 
specific object, or in the case of a simple segmentation techm'que described thcrdn, to a region 
which contains one or more objects at the same depth from the camera (col. 11, IL 1-8). Once 
the macroblock including pixds from an object or region has been assigned, it will be assigned 
to one object or region by macroblock labeling circuit 1 100, a mte controller 1040 can select an 
appropriate quantii^cer step size for the entire current macroblock (coL 11,11.1 2-1 5). 
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For CBR coding, the rate controller 1040 must additionally regulate qtmnti:ser sclection 
so that the output bufTer 1 020 neither overflows nor underflows- Since the total number of bits 
per second which may be output is now fixed, object si2;cs become important (coU 11 , IK 53-57). 
In accordance with a known technique for performing arca-sclcctivc rate control when the object 
locations are known, each object is associated with a particular target average bit rate Ri» except 
for the background (object n). Thus, in CBR coding, Elcfthcriadis appears to determine a target 
object bit rate based on a quanti^r value, rather than an allocation in accordance with the target 
Same mtc, as recited in the present claims 22 and 32. 

In order to mainiabt the given total average raie R necessary to prevent buffer overflow, 
the background rate is detennined according to EQ- (4): 

i^:^ — • • • . :-;.c4) 

where ai is the proportion (from 0.0 to 1.0) of the pixels in the frame that belong to object i (coL 
11, L 67-coL 12, L 10; emphasis added). Thus, the already-«stabh*shed target object bit rates axe 
propordonally summed, the given total average rate K is subtracted from the sum of the 
proportional target object bit rates, and the background rale determined thereftom* 

Eleftheriadis explicitly teaches thai it is possible that R„ (the background bit rate) is 
negative (coL 12, L 16; emphasis added). To one of ordinary skill in the art, this possibility of a 
negative background bit rate demonstrates that target object bit mtes are not allocated in 
accordance with a target fiamc rate. Rather, they must be determined by some other technique 
(such as in accordance with a quantizer value, as explained above, which in turn appears to be 
based on the occupancy B^ax of a buffer [coL 3, U- 22-26], the output rate of which is constant 
and dependant on the bandwidth of the channel which is accepting data from the buffer, sec 
col 3, 11 17-22 [emphasis added]). Eleftheriadis further teaches that the possibility of a negative 
background bit rate may simply have the effect of assigning as coarse quantireation as possible to 
the background, and may result in less average bits per second per object than the target bit mtes 
Ri indicate (coL 12, 1. 16-19), furllier confirming that target object bit rates tfacreui are not 
allocated in accordance with a target frame rate* 
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Thus, there appears to be bo basis in Elefliheriadis for an assertion that EQ. (4) is used to 
determine the target fiame rate; to the exteat R may be related to a target fiamc rate, 
Elcfthcriadis explicitly teaches that it is riven (e,g,, determined a priori^, and as discussed in the 
preceding paragraph, apparcndy dependent on the bandwidth of the channel winch is accepting 
data &om the buffer). There also appears to be no basis in Eleftheriadis for an assertion that 
^art of the target fiame bit rate is aUoeatcd as the target object bit rate''^ other than from reading 
tlic present claims into Eleftheriadis, since Eleftheriadis appears to teach that target average 
object bit rates are based on quantizer selection (sec coL 11, 11. 12-15 and S3-SS; sec also the 
discussion below with regard to VBR coding). Consequently, Eleflheriadis fails to disclose step 
of allocating the target frame bit rate in accordance with a target object bit rate as presently 
claimed in the relevant discussion of CBR coding. 

For VBR coding, Eleftheriadis teaches that macroblock labels can be directiy used for 
rate control by associating particular quantizer step sizes with each object (coL 11, 11* 39-41). 
The encoder can also employ techniques to **smootb out" quantiwr differences at object 
boundaries by gradually changing the quantization step while entering or exiting an object (col, 
11, U. 47-50). A macroblodc labeling circuit 1100 (see FIG, 1 1) contains object identifications 
for each pixel in the macroblock (coL 1 1, IL 16-19), and quantizer selection is simply a lookup 
operation into a table which indexes the possible object idenlificafjons generated by macroblock 
labeling circuit 1100 (coL II, IL 44^7), Also, ElefUieriadis teaches that rate control is also 
usable in a purely VBR encoder to provide higher quality for some image arcas^ and less for 
areas that have smaller significance (e.g^ background areas)* As a result, the term rate control is 
used by Eleftheriadis generally without discriminntfag whether or not a CBR or VBR encoder is 
used (coL 8, 11.40-47). 

Consequently, Eleftheriadis feils to disclose step of allocating the target frame bit rate in 
accordance with a target object bit rate as presently recited in claims 22 and 32. As such, the 
rejection should be withdrawn with regard to claims 22, 32, and claims dependent therefrom. 

Furtliermorc, Eleftheriadis fiiils to disclose the controller of claim 29, which determines 
the target otgeel bit rate from a target frame bit rate. As discussed above, Eleftheriadis discloses 
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a rate controller 1040 that regulates quantizer selection so that the output bufler 1020 neither 
overflows nor underflows (col, 11, 11. 53-57). However, the output rate of the buflbr is constant 
and dependant on the bandwidth of the channel which is accepting data from the buffer (see coL 
3, U. 17-26). Elcfthcriadis does not appear to disclose any connection between the bandwidth of 
the channel which is accepting data from the buffer and a target frame bit mte. As a result, 
Elefthcriadis feils to disclose each and evety element of claim 29* 

Therefore, this ground of rejection should be withdrawn. 



In view of the above amendments and remarks, all bases for rejection are overcome, and 
Uie application is believed to be in condition for allowance. Early notice to that effect is 
earnestly requested. 

If it is deemed helpful or beneficial to the cfiScient prosecution of the present application, 
the Examiner is invhed to contact Applicant's undersigned representative by telephone* 



Conclusions 



Respectfully submitted. 




Andrew D, Fortney, Ph*D. 
Rcg.Na 34,600 



7257 N. Maple Avenue. Bldg. 0, #107 
Fresno, California 93720 
(559)299-0128 
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